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MPEG FLOW IDENTIFICATION FOR IP NETWORKS 
Technical Field 

This invention relates to the art of transmitting real-time-constrained information 
over internet protocol (IP) networks, and more particularly, to identifying particular 
streams of real-time-constrained information, such as video encoded using Motion 
Pictures Expert Group (MPEG)-2 encoding, so that they may be given appropriate 
processing treatment. 

Background of the Invention 

A problem in the art of transmitting packets containing real-time-constrained 
information over internet protocol (IP) networks is the need to give each type of 
information the appropriate processing. In order to do this, it is necessary to know the 
type of information that is contained within each packet as it passes through the network 
at each point at which the packet will be processed. In particular, video, such as using 
Motion Pictures Expert Group (MPEG)-2 encoded video, cannot withstand dropped 
packets. Therefore, in processing streams of packets that contain MPEG-2 video, it is 
necessary to give priority to any MPEG-2 video streams over other streams which are less 
sensitive, or insensitive, to dropped packets. 

Prior art techniques prioritize packets based on predefined criteria without 
actually ascertaining, e.g., by investigating the contents of the packet, that the packets 
actually contain MPEG-2 video. For example, a packet flow may be defined and it is 
assumed that all packets in that flow are MPEG-2 packets, and packets from that flow are 
treated as if they contain MPEG-2 packets without regard for their actual contents. A 
flow is often defined by specifying source and destination IP addresses for the flow, or 
by specifying the source/destination port address thereof. 

Another prior art technique that is used to prioritize packets is based upon the 
so-called "type-of-service" (TOS) byte, which is part of the IP packet header. The TOS 
may be used to indicate a coarse prioritization, so that, for example, it is assumed that any 
packet with either a predefined value in the TOS byte, or a value in the TOS byte that is 
at least a predefined value, contains MPEG-2 video and is treated appropriately. 

Because these prior art techniques do not actually investigate the contents of the 
packet to be certain that it contains MPEG-2 video, it is possible that packets that do not 
contain MPEG-2 video will be processed as if they contained MPEG-2 video. Provided 
that there is sufficient bandwidth in the processing system, processing these non-MPEG-2 
packets, i.e., these fake MPEG-2 packets, as if they were indeed actual MPEG-2 packets 
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is not a problem. However, in the face of limited bandwidth — and what system does not 
have limited bandwidth — processing these fake MPEG-2 packets as undroppable actual 
MPEG-2 packets unnecessarily consumes system resources. Furthermore, these prior art 
prioritization arrangements can be abused by an unscrupulous user who sets his flow, or 
TOS byte, to indicate that he is sending MPEG-2 video, when in reality he is not. 

In addition, setting up the flows in an IP network — the flows being a static 
configuration that specifies fixed ports — requires administration and/or reconfiguration 
each time a flow needs to be changed, i.e., a) when a point to point connection changes 
one of its points, b) when a new connection is made, or c) the like. Note that each switch 
or processing unit through which an MPEG-2 video stream flows must be updated with 
the new flow identifying information each time a flow needs to be changed. Thus, there 
is a constant administrative burden due to the resulting flow churn. 

Another problem that arises in prior art arrangements using the TOS byte to 
define a flow that is to contain MPEG-2 video is the need for all of switches or 
processing units through which the flow passes to agree to a common TOS byte value, or 
set of values, that indicate MPEG-2 video. Otherwise, some switches or processing units 
may not properly handle, e.g., may drop, the MPEG-2 packets. It is difficult in practice 
to arrange for such agreement, especially when the flow travels over multiple networks. 

Summary of the Invention 

We have recognized that that the problems with the prior art can be overcome, in 
accordance with the principles of the invention, by actually determining that a packet 
contains MPEG-2 video rather than using predefined streams or priority levels that are 
assumed to contain such information as is done in the prior art. More specifically, in 
accordance with an aspect of the invention, the "sync" bytes of the MPEG-2 stream are 
searched for within the IP packet payload, and when a pattern indicative of the sync bytes 
is found the sync bytes are identified and the packet is determined to contain MPEG-2 
video. The sync byte was defined in MPEG-2 for over-the-air broadcasting in order that 
a television receiver be able to synchronize the MPEG-2 transport stream packets. Note 
that the MPEG-2 video, e.g., the MPEG-2 transport stream packets, may or may not be 
incorporated within real time protocol (RTP) packets before being incorporated into the 
IP packets. 
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Brief Description of the Drawing 

In the drawing: 

FIG. 1 shows internet protocol (IP) packet that is of the general type for which a 
determination may be made as to whether or not it contains MPEG-2 video based only on 
the packet's IP data pay load in accordance with the principles of the invention; 

FIG. 2 shows an expanded version of a portion of the packet shown in FIG. 1 ; and 
FIG. 3 shows an exemplary process, in flowchart form, for processing an IP 
packet to determine if it contains MPEG-2 video, in accordance with the principles of the 
invention. 

Detailed Description 

The following merely illustrates the principles of the invention. It will thus be 
appreciated that those skilled in the art will be able to devise various arrangements which, 
although not explicitly described or shown herein, embody the principles of the invention 
and are included within its spirit and scope. Furthermore, all examples and conditional 
language recited herein are principally intended expressly to be only for pedagogical 
purposes to aid the reader in understanding the principles of the invention and the 
concepts contributed by the inventor(s) to furthering the art, and are to be construed as 
being without limitation to such specifically recited examples and conditions. Moreover, 
all statements herein reciting principles, aspects, and embodiments of the invention, as 
well as specific examples thereof, are intended to encompass both structural and 
functional equivalents thereof. Additionally, it is intended that such equivalents include 
both currently known equivalents as well as equivalents developed in the future, i.e., any 
elements developed that perform the same function, regardless of structure. 

Thus, for example, it will be appreciated by those skilled in the art that the block 
diagrams herein represent conceptual views of illustrative circuitry embodying the 
principles of the invention. Similarly, it will be appreciated that any flow charts, flow 
diagrams, state transition diagrams, pseudocode, and the like represent various processes 
which may be substantially represented in computer readable medium and so executed by 
a computer or processor, whether or not such computer or processor is explicitly shown. 

The functions of the various elements shown in the FIGs., including functional 
blocks labeled as "processors", may be provided through the use of dedicated hardware as 
well as hardware capable of executing software in association with appropriate software. 
When provided by a processor, the functions may be provided by a single dedicated 
processor, by a single shared processor, or by a plurality of individual processors, some 
of which may be shared. Moreover, explicit use of the term "processor" or "controller" 
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should not be construed to refer exclusively to hardware capable of executing software, 
and may implicitly include, without limitation, digital signal processor (DSP) hardware, 
read-only memory (ROM) for storing software, random access memory (RAM), and 
non-volatile storage. Other hardware, conventional and/or custom, may also be included. 
Similarly, any switches shown in the FIGS, are conceptual only. Their function may be 
carried out through the operation of program logic, through dedicated logic, through the 
interaction of program control and dedicated logic, or even manually, the particular 
technique being selectable by the implementor as more specifically understood from the 
context. 

In the claims hereof any element expressed as a means for performing a specified 
function is intended to encompass any way of performing that function including, for 
example, a) a combination of circuit elements which performs that function or b) software 
in any form, including, therefore, firmware, microcode or the like, combined with 
appropriate circuitry for executing that software to perform the function. The invention 
as defined by such claims resides in the fact that the functionalities provided by the 
various recited means are combined and brought together in the manner which the claims 
call for. Applicant thus regards any means which can provide those functionalities as 
equivalent as those shown herein. 

Unless otherwise explicitly specified herein, the drawings are not drawn to scale. 

FIG. 1 shows internet protocol (IP) packet 101 that is of the general type for 
which a determination may be made as to whether or not it contains MPEG-2 video based 
only on the packet's IP data payload in accordance with the principles of the invention. 
More specifically, in accordance with an aspect of the invention, a search is performed 
for the "sync" bytes of the MPEG-2 stream within the IP packet data payload of packet 
101. When a pattern indicative of the sync bytes is found, the packet is determined to 
contain MPEG-2 video. Otherwise, the packet is determined to contain information that 
is not MPEG-2 video. 

Packet 101 has a series of headers which precede IP data payload 111. In 
particular, packet 101 contains IP header 105, which is 20 bytes long and unreliable 
datagram protocol/transmission control protocol (UDP/TCP) header 107, which is 8 bytes 
long. Note that conventionally IP header 105 and UDP/TCP header 107 are 
conventionally grouped together and referred to as the header for the IP packet. They are 
shown independently in FIG. 1 for clarity of exposition and pedagogical purposes only. 

Note that IP packet 101, as shown, is a UDP packet. This is because, as of this 
writing, UDP is typically used for real-time streaming, as TCP requires end-to-end 
communication. Thus, the invention is described herein in terms of UDP packets in IP. 



D:\PATENTS\Hearn 1-21-lVHeam 1-21-l.doc 



4 



f 



Hearn-Matthews-Yu 1-21-1 




However, those of ordinary skill in the art will readily recognize how to apply the 
principles of the invention to TCP packets. 

IP data payload 1 1 1 follows UDP/TCP header 109. The number of bytes that are 
contained within IP data payload 1 1 1 is flexible, ranging from 0 and up, although certain 
5 transmission arrangements, such as ethernet, may impose other limits. Optional real time 
protocol (RTP) header 109, if present, is 12 bytes long, and is within IP data payload 111. 

FIG. 2 shows an expanded version of IP data payload 111. which, as packet 101 is 
a UDP packet, is a UDP data payload. FIG. 2 shows an example in which UDP data 
payload 1 1 1 is carrying MPEG-2 video. As indicated, RTP header 109 may precede the 

1 0 MPEG-2 video within UDP data payload 111. 

Consistent with any size limitations placed on it, UDP data payload 111 may 
carry any arbitrary number of MPEG-2 transport stream packets 201. Each of MPEG-2 
transport stream packets 201 is 188 bytes in length. By virtue of the definition of the 
MPEG-2 transport layer, the first byte of each of MPEG-2 transport stream packets 201 is 

15 always a so-called "sync" byte 203, which has the value of 0x47. 

In accordance with the principles of the invention, due to the regular spacing of 
the sync byte, it is possible to search through UDP data payload 111 for the presence of 
the expected pattern of MPEG-2 video, i.e., a pattern of having a sync byte as the first 
byte of UDP data payload 1 1 1 — after any optional RTP header — and thereafter having a 

20 sync byte at each byte position in UDP data payload 111 that is a multiple of 188. 
Although finding a sync byte as the first byte of UDP data payload 111, after any optional 
RTP header, gives a strong indication that the IP packet contains MPEG-2 video, and it is 
assumed that for UDP data pay loads of length 188 for which the first byte has the value 
of a sync byte that the packet contains MPEG-2 video, preferably each potential sync 

25 byte position should be checked. This is because the confidence level that MPEG-2 
video has actually been found increases substantially when each position indeed contains 
a sync byte value. 

In the event that most of the expected positions contain a sync byte, but one or 
more do not, whether or not to declare the packet as one containing MPEG-2 video is at 
30 the discretion of the implementor when designing, or configuring, the system. For 
example, if only one position at which a sync byte would be expected was not a sync 
byte, and the IP packet was indicated to have a transmission error, then the implementor 
may decide to have the system still treat the packet as containing MPEG-2 video. 

FIG. 3 shows an exemplary process, in flowchart form, for processing an IP 
35 packet to determine if it contains MPEG-2 video, in accordance with the principles of the 
invention. The process is entered in step 301 when an IP packet is received. Next, in 
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step 303, the packet is processed so there is a pointer that points to the UDP data payload 
within the packet, i.e., a pointer pointing within the packet is incremented to point to the 
UDP data payload. Thereafter, conditional branch point 305 tests to determine if the 
length of the UDP data payload is a multiple of 1 88. If the test result in step 305 is YES, 
5 indicating that there is no RTP header and that the length of the UDP data payload 
corresponds to a multiple of the length of MPEG-2 transport stream packet, control 
passes to conditional branch point 307, which tests to determine if the byte of the UDP 
data payload being pointed to by the pointer has the value of a sync byte, e.g., 0x47. 

If the test result in step 307 is YES, control passes to step 309, which increments 
10 the pointer 188 bytes, i.e., the length of an MPEG-2 transport stream packet. This should 
result in the pointer pointing either at a) the beginning of the next MPEG-2 transport 
stream packet or to the end of the UDP data payload , which is also the end of the packet, 
provided the UDP data payload actually contains MPEG-2 video, or b) just a random byte 
_^ when the UDP data payload does not actually contain MPEG-2 video. Thereafter, control 

Ji 15 passes to conditional branch point 311, which tests to determine if the end of the IP 
Pj packet has been reached. If the test result in step 3 1 1 is NO, indicating that there yet 

J remains additional portions of the UDP data payload to process, control passes back to 

*C step 307 to process the rest of the packet as described above. If the test result in step 311 

J1 is YES, control passes to step 313, and the IP packet is declared to be one containing 

$ 20 MPEG-2 video, in accordance with an aspect of the invention. It may then be further 



processed accordingly. The process exits in step 315. 

If the test result in step 307 is NO, indicating that either the first byte or another 
byte at a 188 multiple position does not have the value of a sync byte, control passes to 
step 315 and the process is exited. 

25 If the test result in step 305 is NO, control passes to conditional branch point 317, 

which tests to determine if the length of the UDP data payload is equal to a multiple of 
188 plus the length of the RTP header. If the test result in step 317 is YES, indicating 
that the UDP data payload may contain an RTP header and thereafter MPEG-2 transport 
stream packets, control passes to step conditional branch point 319, which tests to 

30 determine if the first bytes of the UDP data payload which correspond in length to an 
RTP header, have the characteristics of an RTP header, e.g., there is a video indicator in 
the location where the payload type field is expected. More specifically, the payload type 
field is 7 bits, with the definition for MPEG-2 transport stream data being 0x21 . 

If the test result in step 319 is NO, which indicates that there was no RTP header 

35 or that the header was not indicative of video, control passes to step 315 and the process 
is exited without declaring the IP packet to be one containing MPEG-2 video. If the test 
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result in step 319 is YES, indicating that an RTP header for video was found, control 
passes to step 321, in which the pointer is incremented to point to the first byte after the 
RTP header. Control then passes to conditional branch point 307 and the process 
continues as described above. 

If the test result in step 317 is NO, indicating that the IP packet does not contain a 
whole number of MPEG-2 video transport stream packets, control passes to step 323, in 
which a counter variable COUNT, which is to be used as the offset into the UDP data 
payload, is set to 0. Next, conditional branch point 325 tests to determine if COUNT is 
equal to the sum of 188 and the length of an RTP header. If the test result in step 325 is 
YES, indicating that all the positions that could potentially contain a sync byte of a first 
MPEG-2 video transport stream packet in the UDP data payload have been tested and not 
been found to be a sync byte, the process is exited in step 315, i.e., the packet is not 
declared to contain MPEG-2 video. If the test result in step 325 is NO, indicating that all 
the positions that could potentially contain a sync byte of a first MPEG-2 video transport 
stream packet in the UDP data payload have not been tested, control passes to conditional 
branch point 327 in which another pointer, PACKTPT, is set to the value of COUNT. 

Thereafter, in step 329, the byte within the UDP data payload pointed to by 
PACKTPT is tested to determine if it has the value of a sync byte. If the test result in 
step 329 is NO, indicating that the byte currently pointed to by PACKTPT is not a sync 
byte, control passes to step 331 in which COUNT is incremented, so that it will point to 
the next byte in the UDP data payload. Control then passes back to step 325, and the 
process continues as described above. 

If the test result in step 329 is YES, indj^ing that the byte currently pointed to 
by PACKTPT indeed has the value of a sync byte, control passes to conditional branch 
point 333, which tests to determine if the remaining number of bytes in the packet from 
the place being pointed to by COUNT is less than 188. If the test result in step 333 is 
YES, indicating that a whole MPEG-2 video transport stream packet cannot be contained 
within the UDP data payload, control passes to step 3 1 5 and the process is exited, i.e., the 
packet is not declared to contain MPEG-2 video. If the test result in step 333 is NO, 
indicating that a whole MPEG-2 video transport stream packet could be contained within 
the UDP data payload, control passes to step 335, in which PACKTPT is incremented by 
188. 

At this point, if the UDP data payload indeed contains MPEG-2 video and the 
byte currently pointed to by COUNT is a sync byte, the byte pointed to by PACKTPT 
should also have the value of a sync byte, or at or beyond the end of the packet. To this 
end, conditional branch point 337 tests to determine if the end of the packet has been 
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reached or is exceed. If the test result in step 337 is NO, indicating that PACKTPT points 
to a byte within the UDP data payload, control passes back to step 329 and the process 
continues as described above. If the test result in step 337 is YES. indicating that 
PACKTPT points to the end of the packet or beyond, control passes to step 3 1 3 and the 
process continues as described above. 

Note that the discussion herein with regard to IP refers to IP version 4 5 which is 
essentially universally in use as of the time of the writing of this application. Those of 
ordinary skill in the art will be readily able to apply the principles of the invention to later 
developed version of IP, such as proposed version 6, should one be implemented. 
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